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Given that theory is a crucial component of path 
analysis and that major theories in the social sciences either 
directly or by inference assume interaction, it appears that 
interaction has to be considered in path analytic models that reflect 
those theories. The use of interaction within the framework of path 
analytic methodology is investigated by sampling articles reporting 
the use of path analysis over the last 5 years. The Type VI error, 
the focus of the investigation, has been identified as the incorrect 
use of post hoc procedures and the examination of a research question 
using one or a limited number of designs, studies, or analyses. Fifty 
articl-es on path analysis were identified in the ERIC educational 
reference system. Of the 50, 19 did not test for interaction in any 
way, and they did not compare separate models. Twenty-six used a 
multiple model approach, although it was not made clear that the use 
of multiple models was a reflection of concern for possible 
interaction effects. In eight studies, analysis of variance was used 
prior to the inclusion of variables, and in some cases, interactions, 
in the model. Sixty-eight percent of the articles appeared not to 
consider interaction at all, even though it is fair to assume that 
interaction is implied or explicitly stated in the theories 
underlying all of the models tested. This suggests that Type VI 
errors are being made in a majority of studies using path analysis. 
An extensive table lists the articles reviewed and the methods they 
use. (Contains 49 references.) (SLD) 
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The purpose of this paper is to discuss and investigate the use of interaction 
within the framework of path analytic methodology. Bollen (1989) identified three 
ways that path analysis and structural equation modeling tend to be used: 

1. In a confirmatory manner, which is the most traditional and is totally theory 
driven. 

2. For testing alternative models, which may be reflective of cc>nflicting 
theories, and 

3. TTie use of structural equations in an exploratory sense, which often 
attempts to intenweave the interpretations of the nomological nets that 
emerge. 

One traditional requirement for using path analysis is the development of 
models that are then statistically evaluated. "A model is a formal representation of a 
theory" (Bollen, 1989, p.71). Models are derived from theories and, therefore, theory is 
an essential part of the path analytic process (Duncan, 1966, 1975; Featherman, 1976; 
Williams, 1978; Blalock, 1964, 1971; Heise, 1975, 1976, 1977; Joreskog, 1986, 1988). 

Given that theory is a crucial component of path analysis, and that major 
theories in the social sciences either directly or by inference assume interaction, it 
appears that interaction has to be a considered in path analytic models that reflect 
those theories. Models built with the intention of testing a theory, which do not reflect 
the interactions of that theory, are making a statistical as well as a research design 
error. The authors are referring to this as a Type VI error, which is an inconsistency 
between the research question and the statistical model built to reflect it (Newman, 
Deitchman, Burkholder, Sanders, & Ervin, 1976, 1992). 

A number of statistical and methodological errors have been defined in the 
research, starting with the traditional Type I and Type II errors. Huck and Cormier 
(1974) have identified Type ill, Type IV and Type V errors. However, there are at least 
three versions of Type ill error: 
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1. The first version has to do with the selection of an inappropriate test of 
significance which does not fit the characteristics of the available data. 

2. This has been identified by Kaiser (1960) as an incorrect decision 
concerning the direction following the rejection of a false Null. For example, one may 
test for interaction and correctly reject the Null hypothesis, and then proceed to plot the 
interaction by plotting the cell means. Statistically, one should be plotting the residual 
means of the cells that are independent of the main effects. 

3. The third version was attributed to Kimball (1957), who identified a Type III 
error as, "Giving the right answer for the wrong reason" (p. 133). 

A Type IV error has been identified by Marascuilo and Levin (1970) as the 
incorrect use of post hoc procedures. Within this category one might place the 
inappropriate choice of a particular multiple comparison technique. 

Huck and Cormier (1974) identified a Type V error as one that is committed 
when researchers tend to look only at their research question using one or a limited 
number of designs, studies and analyses. Huck and Cormier place emphasis on the 
importance of replication. 

The Type Vl error, identified by Newman et al. (1976, 1992) is the focus of this 
invesiigation. That is, the authors are investigating the potential inconsistencies 
between path analytic models and the theories they proport to reflect. Given that very 
few, if any, well developed theories in the social sciences assumes that there is no 
interaction among the variables inherent in the theory, and given that path analytic 
models should reflect the theories upon which they are based, studies using path 
analysis should frequently, if not always, test or consider interaction in the building of 
models. 

The authors decided that an appropriate method for estimating the frequency of 
path analytic researchers considering interaction within their models, would be by 
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sampling 50 articles reporting the use of path analysis, over the last five years. More 
specifically, this paper has three objectives. They are to: 

1. Review published articles on path analysis in education between 1987 and 
1992, identified through an ERIC computer search. 

2. Determine how often intera^Jtion is considered in the path analysis models 
used in those 50 articles, and 

3. Identify and summarize how researchers who considered interaction, dealt 
with the interaction. 

Methods 

In an effort to identify journal articles using path analytic procedures, a literature 
search was conducted using the ERIC educational reference system. The key words 
"path analysis" and "research" were entered in a search of the 1981 to present data 
base. The review process involved reading the articles in order to determine whether 
or not the researchers considered interaction effects in their analysis. Articles were 
collected in reverse chronological order until a total of 50 articles were reviewed. A 
second reviewer read the articles to establish the reliability of the evaluations of the 
articles. The second reviewer continued reading the articles until 100% agreement 
was reached on at least 10 consecutive evaluations. 
Results 

The ERIC search yielded 496 entries. Most of these entries were ERIC 
documents. A number of the articles were methodological in nature, rather than 
reporting the results from a study using path analysis. Articles not available from the 
university library were ordered through interlibrary loan (17 articles). The sample 50 
articles ranged from 1992 back to 1987 (microfiche documents and microfilm journal 
articles were not considered.) 

Three of the first five evaluations of the articles were changed by consensus of 
the two reviewers. The reviewers were in total agreement concerning the next 12 
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articles, and the remainder of the articles were/eviewed by one reviewer. However, 
approximately five additional articles were checked by the second reviewer and in all 
cases the second reviewer agreed with the first. 

Of the 50 articles reviewed, 19 did not test for interaction in any way, nor did 
they compare separate models. In these studies the path analysis was desiyned to 
determine direct and indirect causation. Twenty-six studies used separate models and 
compared the model weights. In most cases this was a comparison of two models, 
such as males and females (e.g. Jacobs, 1991) or adopted and natural born children 
(e.g.. Rice et al., 1988). In all but six of these studies there was no prior test of 
interaction (such as anal/sis of variance) or any other indication that the purpose of 
using separate models was due to the belief that interaction effects were occurring. 
The use of different models was limited to a comparison of differences between what 
might have been considered main effects. In five of the studies an interaction term was 
included in the path model. In all of these five cases the interaction term only dealt 
with first order interactions. 
Discussion 

In 19 of the 50 articles (more than one third) there was no indication that the 
researchers were sensitive to the need to consider interaction. Twenty-six of the 50 
(approximately half) used a multiple model approach, however it was unclear that their 
use of multiple models was a reflection of their concern for possible interaction effects. 
It appeared that there were no apriori tests for interaction, with the exception of eight 
studies in which analysis of variance was used prior to the inclusion of variables, and 
in some cases interactions, in the model. Therefore, it appears that 15 of the 26 cases 
that used multiple models did so for reasons other than out of consideration for 
interaction. Sixty-eight percent of all of the articles reviewed appeared not to consider 
interaction, even though it is fair to assume that interaction is implied or explicitly 
stated in the theories underlying all of the models tested. Thus, there seems to be a 
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great possibility that Type Vl errors are being made in a majority of the studies using 
path analysis procedures. 

In addition, some of the terminology in path analytic procedures has lead to 
confusion. For instance, the terms "buffering" and "indirect" have been interpreted by 
some to be analogous to interaction. The tendency for some to consider indirect 
effects as taking the place or as comparable to interaction further increases the 
likelihood of misinterpretation. Indirect effects are a form of analysis of covariance 
which requires no interaction (homoscedasticity of regression slope) for a correct 
interpretation. Not only would it be inappropriate to interpret indirect effects, it would 
also be inappropriate to consider direct effects if interaction was occurring. This would 
be analogous to making the error of considering main effects in analysis of covariance, 
when interaction was significant. 

This does not imply that it is not possible to consider interaction and include 
interaction terms in path analytic models. However, significant interaction terms make 
a model much more difficult to interpret, and the research presented here suggests 
that few attempts were made to consider interaction in any form. 

Note that none of the articles reviewed considered higher order interactions (3- 
way, 4-way, 5-way, etc.). This is not only a problem for those conducting path analysis, 
but for researchers in general (including those using multiple regression). However, if 
the theory suggests higher order interaction, it is necessary that the path model reflects 
that interaction. 

Most theories considering human nature suggest that a complex interaction of 
variables is present. When testing a causal model, it is always logical to consider the 
possibility that two or more of the variables may be interacting in ways that could 
significantly impact on the outcome. Ignoring these interactions can be extremely 
misleading (a Type VI error). The review of the current literature has indicated that 



interaction is often cverlooked, which may have led to incorrect inferences. It is hoped 
that this paper will sensitize researchers to the need and value of checking for 
potential interaction. 
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Table 1 

Articles Reviewed and Methods Used to Test for Interaction 



Author 



Date 



Topic 



Criefion Predictor 
Variables Variables 



Interaction 
Tested 



Chan, at al 1 992 



Ethington 

Guelzow 
etal. 

Jacobs 



1992 
1991 

1991 



Kavaleetal. 1991 
Kemberetal. 1991 



Thompson 
etal. 



1991 



Learning via constructive 
activity 

Model for achiev. behav. 

Stress & gender in dual 
careers 

Parental/child attitudes & math 
grades 

Structure of learning disabilities 
Student attrition 
Television viewer activity 



Brainerd et al. 1 990 Age & forgetting 



Camarena 
etal. 



1 990 Gender intimacy in 



Cardonetal. 1990 

Culver etal. 1990 

Kyriosetal. 1990 

Morcoletal. 1990 



Neumann 1990 
etal. 

Pokayetal. 1990 



Sorbin etal. 1990 
Skaaiviketal. 1990 



Genetic correlations with 
reading & IQ 

Model of teacher satisfactbn 
3-5 Year olds' causes 



Residual plotting of 4 yr. 
& higher educ. Tech. 

Burnout in universities 



Motivation strategies 
& achievement 

Gender & academic perfomiance 
Academic self concept 



1 
1 

6 

1 

1 

1 
1 



9 ANOVA 

1 0 Tenn &Sep 

4 Sep & models 

4 ANOVA & Sep 

5 No test 
10 Notes! 

9 Sep models 



2 ANOVA. Term 

Sep. nrKxlels 

2 Sep. models 



5 Sep. nrvxiels 



7 Sep. models 

7 No test of 

behavior 

3 Sep. nDodels 



3 No test 

9 ANOVA, Temi 

& Sep models 

7 Sep. nrxxJels 

4 Sep. models 
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MUlllUf 






Criterion 
Variables 


Pradictor 
Variables 


Interact bn 
Tested 


oKinner ei ai. 


lyyu 


r^Brceiveu cuniroi ot ck^iiiwuiiweu 




4 


ANOVA 


watKins 01 aj. 




o8ii concepi, ouriuuuuns>, 
& achievement 




5 




wong 




JOU oclUSlaullOn ul WOnv i#t7lUiauiy 






SeD moriels 

ilfWiwi«9 


Allen 6t al. 


1989 


^kxiel of college withdrawal 


1 


6 


Sep. models 


Braxton 


1989 


Student attrition 




6 


No test 


Fr6sko et al. 




raCiorb on luior ot luitzu 
satisfaction 




7 


No test 


Hassenfeld 
etaL 


1989 


Attitudes toward welfare 




13 


No test 


Haury 


1989 


Locus of control & attitudes 
10 science leacniny 




7 


No test 


Uapotoy ei ol. 








4 


ANOVA & Sep, 


KAr*^^f\\t at al 




nomniitAr nrorsmrnminn A 

mathematical problem solving 




6 


No test 


Pihl et al. 


1989 


Predict of active researchers 




7 


No test 






^/vifll nrintrf\l thfifttv 




9 


No test 


Kline et aL 


1987 


Teenage alcohol use 


4 


7 


No test 


Mednick et al. 


1987 


Divorce & son's crime 




3 


ANOVA 


Moline 


1987 


Financial aid & student 




10 


Inter, term 
persistence 


Getting & 


1987 


Peer group and dnjg abuse 




5 


No test 



Beauvais 
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Author 


Date 


Topic 


Criterion 


Predictor 


Interaction 






Variables 


Variables 


Tested 


Strom et ai. 


1987 


Course difficulty & test ar^xiety 


1 


4 


No test 


Vaux 6t ai. 


1987 


Social support 


1 


4 


Sep. models 



Note: No test for interactions = 1 9 

Used separate nxxJels = 26 

Analysis of variance = 8 

Included interaction temn = 5 

Tested other than separate models = 1 1 

Total number of articles reviewed » 50 
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Additions to .7/^6 I £ 



Eiii©on 1002 N<>oniat*X c^re & ISrno* 

«1 . devolopoental 4 yrs 

Garcin- 19S2 Achftivexneiit uiv^LivaLion in 

Celay et a^lt high schoolers 



Boyes 



Cool 
et al . 



1991 Student use of 
Microcomputers 

1991 Academic acnievement 



2 
2 
4 



2 

1 



10 Sep models 



7 Sep. models 



13 No test 



8 Inter, term 



Cambell 1<)9o Rnrnllm^nt in 



ooQiiput«r oouraes 



14 Sep. model? 



Schebeci 1989 Attitudes 4 science achiev* 
1988 Student attrition 



Braxton 
et ai . 

Dunton 

J«f f r«y« 

et al . 

Keith 

Rice 
et ai . 



Sraylie 
et al . 



Tunmer 
et al « 

van 

Blerkcm 

Fries 
et al. 



6 
1 



1988 Mothers' attributions t 

nhildr*>nsa' math perf orm^anci? 

1983 Vocational ctud«nt 

organization participation 

1988 Influences on learning 

1988 IQ & home Environment in 

adopted or natural children 

1988 Antecedexiti* tu Itf^cher 
change 

1988 Metalinguistic abilities 
k reading 

1988 tender & other variable 
in college students 

1987 Genetic stability of 
cognitive development 



1 
1 

1 

2 

1 
1 



8 bep. modelB 

8 No test 

2 Sep. models 

8 No tect 

8 No test 

10 Sep. models 

7 No tesx 

4 Sep. models 

9 ANOVA & Sep. 
XO/8 Sep. models 
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